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BACKGROUND OF THE INVENTION: 

FIELD OF THE INVENTION: 

The present invention generally relates to the 
optimization of component -based computer applications, 
5 which can be done automatically by a novice user, or 
manually by a user with domain knowledge without having 
to recompile or re-deploy the application* 

DESCRIPTION OF RELATED ART: 

The Component Balancer described herein 
10 establishes and maintains response time goals for 
selected business logic contained in methods in 
component -based applications. The premise for this 
optimization is that business logic in component methods 
can be driven to response time goals by selectively 
15 delaying business logic in other component methods - e.g. 
two methods accessing the same table in a database. 

This optimization can be done automatically by 
a novice user, or manually by a user with domain 
knowledge. 

20 The Component Balancer leverages infrastructure 

technologies that support component -based optimizations, 
allowing the Component Balancer to work on a running 
system without recompiling or redeploying the 
application . The Component Balancer establishes and 

25 maintains response time goals on business logic contained 
in methods in component technologies - such as C0M+, .NET 
and BEA Weblogic EJB. As the load on the system varies, 

the Component Balancer attempts to keep methods with 
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response time objectives at a specified target 
performance level at the expense of lower priority 
methods. 

Features of the Component balancer include 
5 automated or manual operation, an analysis capability 
that provides optimization hints, the ability to self- 
tune under variable load across machines, applications 
and application servers, with no changes required to the 
application itself. These features include the benefits 
10 of high priority methods responding consistently under 
variable load, and smoother resource utilization under 
peak load. 

One related art method to which the method of 
the present invention generally relates is described in 

15 U.S. Patent No. 5,822,749, entitled "Database System With 
Methods For Improving Query Performance With Cache 
Optimization Strategies". This related art method is a 
database system and method for improving execution speed 
of database queries (e.g., for transaction processing and 

20 for decision support) by optimizing use of buffer caches. 
The system includes an Optimizer for formulating an 
optimal strategy for a given query. More particularly, 
the Optimizer communicates with a Buffer Manager before 
it formulates the query plan. For instance, the Optimizer 

25 may query the Buffer Manager for the purpose of 
determining whether the object of interest (e.g., table 
or index to be scanned) exists in its own buffer cache 
(i.e., whether it has been bound to a particular named 
cache) . If the object exists in its own cache, the 

30 Optimizer may inquire as to how much of the cache (i.e., 
how much memory) the object requires, together with the 
optimal I/O size for the cache (e.g., 16K blocks). Based 
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on this information, the Optimizer formulates a query 
strategy or plan with "hints," which are ultimately 
passed to the Cache or Buffer Manager. By formulating 
"hints" for the Buffer Manager at the level of the 
5 Optimizer, knowledge of the query is, in effect, passed 
down to the Buffer Manager so that it may service the 
query using an optimal caching strategy- -one based on the 
dynamics of the query itself* Based on the "hints" 
received from the Optimizer, the Buffer Manager can fine 

10 tune input/output (i.e., cache management) for the query. 
Specific Optimizer strategies are described for each scan 
method available to the system, including heap scan, 
clustered index, and non- clustered index access. 
Additional strategies are described for multi-table 

15 access during processing of join queries. 

The present invention differs from the above 
prior cited art in that the prior invention, focuses on 
database queries, whereas the method of the present 
invention focuses on method calls. The method of the 

20 present invention optimizes across multiple machines and 
performs method optimization whereas the method of the 
prior related art only optimizes database queries on a 
single machine. 
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BRIEF SUMMARY OF THE INVENTION: 

An embodiment of the invention is the ability 
to accomplish optimization with the Component Balancer 
for the benefit of high priority methods, which respond 
5 consistently under variable load, and for a smoother 
server resource utilization under peak load. 

The Component Balancer establishes and 
maintains response time goals on "business logic"- such 
as COM+, .NET and WLS methods. It does this by delaying 

10 other, related business processes that can occur in 
different applications\application servers or on 
different machines. As the "load" on the system 
increases, the business processes with response time 
goals attempt to remain at a user specified target 

15 performance level. As the load decreases, the delays on 
the other business processes are reduced. 

The Component Balancer leverages various core 
technologies. The key core technology provided is the 
ability to wrap component methods with "conditioning" 

20 code. The inserted conditioning code is called a 
conditioner. Conditioning can be added and removed while 
an application is running. No component source code is 
needed and no recompilation or reconfiguration of the 
components is required. Multiple conditioners can be 

25 applied to a method. In addition to executing pre and 
post processing code, conditioners also have access to 
the parameters of a method, can capture and throw 
exceptions and can bypass the method execution. For 
COM+, the core of the conditioning capability is an 

30 extended version of Keith Brown's Universal Delegator. 
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For other application servers, such as Weblogic or .NET, 
other interception or wrapping techniques are used. 

Still other objects, features and advantages of 
the present invention will become readily apparent to 
5 those skilled in the art from the following detailed 
description, wherein is shown and described only the 
preferred embodiment of the invention, simply by way of 
illustration of the best mode contemplated of carrying 
out the invention. As will be realized, the invention is 

10 capable of other and different embodiments, and its 
several details are capable of modifications in various 
obvious respects, all without departing from the 
invention. Accordingly, the drawings and description are 
to be regarded as illustrative, in nature, and not as 

15 restrictive and what is intended to be protected by 
Letters Patent is set forth in the appended claims. The 
present invention will become apparent when taken in 
conjunction with the following description and attached 
drawings, wherein like characters indicate like parts, 

20 and which drawings form a part of this application. 
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BRIEF DESCRIPTION OF THE DRAWINGS: 

FIG. 1 is a diagram illustrating the 
architecture of the Component Balancer. 

FIGS. 2A and 2B combined illustrate flowcharts 
5 of the analysis detail of the Component Balancer. 

FIG. 3 illustrates a flowchart of the 
optimization detail of the Component Balancer. 

FIG. 4 illustrates a diagram of the fuzzy logic 
used in the Component Balancer. 
10 FIG. 5 is a drawing of the system of digital 

modules used to implement the use of the Component 
Balancer. 

FIG. 6 is a screen shot for monitoring the user 

interface. 

15 FIG. 7 is a drawing screen of the Analysis 

Report . 

FIG. 8 is an example of a performance demo 
utilizing three methods. 
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GLOSSARY ITEMS: 

1. User-Defined Behavior : A specific action to be 
performed on a component method call. 

2 . Component Runtime Conditioner (CRC) : A suite of 
tools and technologies that enable a user to tune, 
optimize and add- value to component -based 
applications. The CRC consists of core technologies 
and conditioning tools. 

3. System Warehouse: Used to collect and store system 
performance data in the form of a data warehouse. 
The System Warehouse contains data collected from a 
variety of traditional sources such as system 
management tools, performance-monitoring tools, and 
system logs. 

4» Conditioning Tools: Tools necessary to manage the 
conditioning lifecycle of discovering and capturing, 
organizing and conditioning components and their 
methods. A graphical user interface (GUI) is 
provided to do this. 

5. Microsoft Message Queuing (MSMQ) : A service from 
Microsoft that provides a data queuing service. 

6. Manual Optimization: A User choosing to manually do 
the analysis step by picking a reasonable set of 
methods and condition them for analysis and then 
deciding which conditioning to deploy based on the 
report . 

7 * Automatic Optimization: Given a prioritized list of 
applications to optimize, the Component Balancer 
automation discovers and captures all components, an 
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analysis is made to determine which methods to 
optimize or delay, and the appropriate optimization 
conditioning is then deployed. 

8. Fuzzy Logic; A mathematical principle that states 
5 that something is true does not preclude the 

possibility that it is at least partly false. Fuzzy 
Logic provides a gradation of truth- value, allowing 
inferencing to take place at the linguistic level 
(e.g. if response is fast and load is OK then 
10 adjustment = none) . 

9. F- Value; A one-way analysis of variance technique. 

10 . "Defuzzify"; Conversion of a fuzzy (linguistic) 
value into a numerical value (e.g. "slow" can range 
from 1 to 10) . 

15 11. "Fuzzify"; Conversion of an input value into a 

fuzzy (linguistic) value (e.g. input can range from 
97 to 99 to be a "normal temperature") . 
12 . Runtime Data; A snap shot of component data 
collected at a particular time during an application 

20 runtime. 

13. Interception Infrastructure ; A subsystem that 
performs the interception on a component method 
call. 

14. Conditioning Code ; The code to be executed at 
25 runtime before and/or after on a call to a component 

method. 

15. Component Method ; A business service operation 
provided by a component 

16. Method Call ; A call from a client program to a 
3 0 method of a component. 
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17. Run t ime Condi t i on ing ; Injecting user-defined 
conditioning code into a runtime component. 

18 • MSMQ: Microsoft Message Queuing - An asynchronous 
messaging technology. 
5 19. Keith Brown's Universal Delegator; A technique for 

intercepting method calls to C0M+ components. The 
described technique requires that the client program 
be modified and recompiled in order to use this 
capability. The present disclosure has modified 
10 this approach to no longer require these 

restrictions. More background is explained at the 
following publications: 

• Brown, Keith, Building a Lightweight COM 
Interception Framework, Pert I: The Universal 

15 Delegator, Microsoft Systems Journal, Vol. 14, 

pp. 17-29, January 1999. 

• Brown, Keith, Building a Lightweight COM 
Interception Framework, Part II: The Guts of 
the UD, Microsoft Systems Journal, Vol. 14, pp. 

20 49-59, February 1999. 

2 0. Persistent Store: Data stored on disk that is 
available across different instantiations of an 
application or reboots of a computer. As opposed to 
non-Persistent store, which is only available during 
2 5 the time an application is running. 

2 1 . Component : Software components are defined as 

prefabricated, pre- tested, self-contained, reusable 
software modules- bundles of data and procedures - 
that perform specific functions. 
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22 . Interface of a Component : A public contract for 
accessing a component's behavior. 

23 . Method of a Component: The actual code executing in 
a component that implements the interface. 

24 . Automation Code; The code in the Component Balancer 
that provides the performance of automatic 
optimization . 

2 5. Calling Sequence: The order of method calls through 
various components. For example, method A in 
component B calls method C in component X, etc. 

26. WLS (WebLogic Server); A J2EE product developed by 
BEA Corporation. 
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GENERAL OVERVIEW: 

The major functions of the Component Balancer are: 

• Analyze 

• Configure goals 

5 • Monitor response times 

Analyze: 

The user first picks a few significant methods 
and conditions them for analysis. Analysis gathers 
runtime data from selected methods and looks for 
10 statistical significance between pairs of methods. 
Analysis gives the user a good start on what methods 
would make good candidates for delay and what methods 
would be improved the most if these selected targets were 
delayed. 

15 For example, if the user picks a database 

update method as a potential candidate for optimization, 
then other methods that also access that particular 
database are likely candidates for delay. 

The user then collects data for a period of 

20 time to get a representative workload and views the 
analysis report to determine which methods are most 
affected by which other methods. This gives the user a 
reasonable "hint" at what method (s) might be improved and 
what methods could be delayed. The analysis step is 

25 optional. 

Configure Goals: 

The user then conditions the desired methods as 
either a candidate for optimization or else targets for 
delay and then monitors the response times of the 
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candidates for optimization on the optimizer user 
interface. Methods targeted for delay can be grouped and 
an overall goal can be established for each group. The 
range of the goal is from no goal - where no delays are 
enabled - to the max goal - where the most aggressive 
delays are allowed. Goals can be changed at any time. 

The user can adjust the goal and view the 
effect before picking a setting, or abandoning the 
optimization if the effect is unacceptable. 

Monitor Response Times: 

The individual methods in the optimization 
groups are graphically monitored against the goal. 
Running average response times in milliseconds are 
plotted against the response time goal and running 
average calls per second are also graphed to show load 
trending. 
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DETAILED DESCRIPTION: 

FIG. 5 illustrates the modules used in the 
Component Balancer. A client personal Computer (PC) 
exists 5000, which includes the User Interface (UI) of 
5 the Component Balancer. From the Client PC, DCOM 
(Distributed Component Object Model) , a remote procedure 
call mechanism for Microsoft COM is sent to the 
Management Server PC 5002, which stores data in the CRC 
Repository 5004. From the Management Server PC, DCOM is 

10 sent to anything from computers to Unisys ES7000's, which 
are called targets. It is important to note that there 
can be any number of targets from 1 through N. 

A target 5006 includes the interception 
subsystem. The interception subsystem is an 

15 infrastructure that performs the interception on a 
Component method call. This target 5006 stores data in 
the MSDE (Microsoft SQL Server Data Engine) 5010. This 
data is used by the interceptions subsystem to determine 
which conditioning code to apply on which methods when 

20 those methods are called. MSDE is a data engine, 
reliable storage engine, and query processor for desktop 
extensions of enterprise applications. Target 5008 is 
also a target, which stores information and data in the 
MSDE 5012. 

25 One embodiment of the invention is a method 

that establishes and maintains response time goals for 
selected business logic contained in methods used in 
component -based applications. Benefits of the described 
Component Balancer are high priority methods that respond 

30 consistently under variable load, and provide smoother 
server resource utilization under peak load. The key 
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features of the Component Balancer include an analysis 
capability that provides optimization hints, the ability 
to self -tune under variable load across machines, 
applications and application servers, and the option of 
5 an automated or manual operation* 

Since the conditioning is added to a running 
system, infrastructure and tooling is necessary to manage 
the conditioning lif ecycle of discovering and capturing, 
organizing and conditioning components and their methods. 

10 This infrastructure and tooling is called the Component 
Runtime Conditioner (CRC) . A graphical user interface 
(QUI) is provided to do this that is easy to use (task 
oriented, drag-and-drop conditioning) and has a 
persistent store to remember what conditioners have been 

15 applied to component's methods on which particular 
machines and also their current status - running, 
scheduled or stopped. This was described in the cited 
USSN 626,222 in the Cross -Ref erences . 

A multi-level API is exposed to enable core 

20 capabilities of the Component Runtime Conditioner to be 
embedded into applications - like the Component Balancer. 
Communication between user interfaces and the persistent 
store and between the persistent store and remote agents 
is done using XML (Extensible Markup Language) - a 

25 language for documents containing structured information. 

The major functions of the Component Balancer 
are: (a) to discover and capture applications, (b) to 
analyze and configure optimization (manually or 
automatically) and (c) to monitor response time 

3 0 objectives. 

awk \ app 1 \ AWKO 2-004.doc 



16 

(a) Discover and Capture Applications: 

The Component Runtime Conditioner user 
interface (UI) is leveraged to discover and capture 
machines, applications and components that can then be 
5 optimized. 

(b) Analyze and Configure Optimization: 

Optimization can be done manually or 
automatically. Manual optimization is supported directly 
by a Component Runtime Conditioner tool. 

10 (bl) Manual Optimization: 

To begin manual optimization, the user can 
optionally do the analysis step. The user picks a 
reasonable set of methods and conditions them for 
analysis. Analysis collects runtime data from the 

15 selected methods and creates a report that gives the 

user a good idea on what methods would be improved 
the most if certain other methods were delayed and 
what methods, if delayed, would provide the best 
overall performance improvement. 

20 For example, if the user picks a database 

update method as a potential for optimization, then other 
methods that also access that database are likely 
candidates as targets for delay. If the user has domain 
knowledge of the applications, he\she can deploy the 

25 desired conditioning and skip the analysis step. 

The user then conditions a set of candidate 
methods for optimization and for delay based on the 
results of analysis and monitors the results to see if 
the optimization is effective. 

30 
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(b2) Automatic Optimization: 

Given a "prioritized list" of applications 
to optimize, the Component Balancer automation can 
perform the steps given below, i.e. capture, 
5 analysis, and monitoring. 

All the components for each application in the 
list are discovered and captured. The user can override 
this and tell the Component Balancer automation to use 
already captured components. Capturing a component 

10 consists of discovering the interfaces and methods of 
that component and putting this information into the 
persistent store. 

An analysis run is made, using a time period 
specified by the user. Analysis conditioning is applied 

15 to all methods of all components chosen for analysis. 
During the analysis period, data is collected from the 
running applications and periodically analyzed and 
accumulated, looking for candidate methods for 
optimization and candidate methods for delay. After the 

20 analysis period is complete, a digested version of the 
analysis results is given to the automation code, which 
then determines which methods to optimize and which 
methods to delay. After the methods to optimize and to 
delay are chosen, the analysis conditioning is removed 

25 and the appropriate optimization conditioning is 
deployed . 

(c) Monitor Response Time Objectives: 

The user can monitor the progress of the 
analysis by viewing the analysis report and, later, can 
30 monitor how the deployed conditioning is running. The 
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Component Runtime Conditioner tool is used to modify the 
deployed conditioning, if necessary. 

FIG. 1 is an illustration of the general 
architecture of the Component Balancer. This diagram 
5 shows the major pieces of the Component Balancer and 
their relation to the Component Runtime Conditioner 
modules and the System Warehouse. It should be noted 
that in the diagram, CRC indicates Component Runtime 
Conditioner modules and CB indicates Component Balancer 
10 modules. 

The architecture consists of three tiers - the 
client level (items 1000, 1001), the management server 
level (items 1002-1007) and the target partitions level 
(item 1008) . The client level tier is where the user 

15 interfaces 1000,1001 (UI) run. The management server 
level houses the Component Runtime Conditioner (CRC) 
Server 1006 APIs and CRC Persistent Store 1002, the 
System Warehouse 1003 and the Component Balancer (CB) 
optimization and automation modules 1004, plus the CB 

20 server 1005 and MSMQ 1007. The Target partitions level 
can be partitions on enterprise level systems or 
individual systems and this is where the applications run 
and the optimizations take place. 

The Component Balancer (CB) consists of the 

25 user interface (item 1001) , an always -running optimizer 
CB server 1005, an automation function where, a 
conditioner server 1006 that is deployed to the target 
partition 1008 and its corresponding custom plug-in that 
is available through the Component Runtime Conditioner 

30 user interface (item 1000) during manual operation. 

The Component Balancer (CB) user interface 
(item 1001) controls the optimization process. It brings 
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up the Component Runtime Conditioner user interface (item 
1000) in various modes to perform some of its tasks. 

The Component Balancer server (item 1005) does 
the closed- loop optimization . The Component Balancer 
5 server (1005) also generates analysis reports and stores 
results in the System Warehouse (item 1003) . 

The Component Balancer conditioning code runs 
on the target partition 1008 where the application is 
running and, based on its parameters, writes response 

10 time data to a queue (MSMQ) 1007 that feeds the Component 
Balancer (CB) server (item 1005) or calculates delay 
values and delays methods. The Component Balancer (CB) 
uses Microsoft Message Queuing (MSMQ) (item 1007) to 
provide the data queuing service. 

15 The Component Balancer automation function 1004 

does automatically what a user would do manually. The 
Component Runtime Conditioner (CRC) and Component 
Balancer components are capable of recovering from 
management server, failures and network and target 

2 0 partition failures or outages. 

FXQS. 2A and 2B illustrate the steps and 
processes of the analysis function in the Component 
Balancer. Analysis occurs over a time interval that is 
specified by the user while the application is running. 

25 The overall analysis time is divided into a number of 
analysis periods. Each period is treated as an 

independent set of statistics representing the system as 
observed during that period. Analysis results during 
each period are accumulated into a raw analysis report. 

30 PIG. 2 A begins at step 2000 and runs 

periodically. An analysis is run every 15 minutes, or 

earlier if the amount of data collected crosses a 
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threshold before 15 minutes. During each analysis 
period, pair wise calculations are done on methods to 
determine as to which methods are affected by other 
methods (Block 2 001) . For example, deploying analysis 
5 conditioning for methods A, B and C result in pairs AB, 
BA, AC, CA, BC and CB being analyzed. 

When pair AB is analyzed (Block 2002), the 
average response times for all calls to method A during 
the sample period when it ran "by itself" is calculated 

10 (Block 2003), that is, without the method B running at 
the same time. Then, the average response times are 
calculated for all calls to method A during the sample 
period when it ran overlapped with method B (Block 2004) . 
Method A must start AFTER method B started to be 

15 considered as overlapped. This is based on the 

assumption that the first method "in" will get any 
contended resource - such as a database lock. 

A statistical number called the F-value is 
calculated that reflects the variance between the average 

20 non- overlapped and averaged overlapped response times for 
A during the analysis period. 

An example of the F-value calculation is shown 

below: 

{a — All A' s) 2 + (AB ~ All A's) 2 
25 F AB = 

2^(4- & + Z,Ja-ab) > 

nA nAB 

Where F AB represents the variance between A and B. 
(A) o a response time of method A. 
30 (B) = a response time of method B. 
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{a)~ Average response time of A itself during the 
sample period. 

[ab)= Average response time for A overlapped with B 
during sample period. 

5 ( All A's)= Represents the average response time of all 

method A's during sample period* 

nA = The number of response times for method A 
collected during the sample period. 

ltAB = The number of response times for A and B 
10 overlapped collected during sample period. 

The "significant" percentage is set to 60%. If 
the F statistic is greater than 60%, then A is assigned a 
+1, and B is assigned a - 1. 

All the above applies also to the other methods 
15 A, B, C, and their pairings AB, BA, AC, CA, BC, and CB. 
As an example - if B might affect A, then B would be set 
at -1, while A would be set at +1. 

The final report adds up all the A's and all 
the B's (likewise for C's). For example: 
20 A may come to = +130 

B may come to = -30 

C may come to = +20 
So that a large positive result indicates a candidate for 
optimization, and a large negative result indicates a 
25 candidate for delay. 

An inquiry is made at step 2005 to check if the 
deviation of the average response time of ALL calls to 
method A during this analysis period is below a given 
threshold, or if the average response time of ALL calls 
30 to A is below 10 milliseconds (Diamond 2005) . if the 

awk\appl\AWK02-004 .doc 



22 



answer to inquiry 2005 is "No", and the average response 
times were less than 10 milliseconds, the F- value is not 
calculated (Block 2005N) . This means that it is very 
unlikely that method A was affected by method B since the 
5 overall variance is low. It is important to note that 
methods with less than 10 milliseconds average response 
time during the analysis period are not worth optimizing 
and no F-value is calculated. If the answer to inquiry 
2005 is "Yes, the F-value is calculated at step 2005Y. 

10 The individual measurements of the response 

times are used to calculate the F statistic. The F-value 
is named after the statistician R. A. Fisher. It is used 
to determine if the mean values of two random variables 
are statistically different, assuming a level of 

15 significance. The statistic is useful because it applies 
a proven technique to determine equality in an area of 
uncertainty. For example, if the two random variables 
each have a high level of variance, the hypothesis that 
their means are equal will be a function of the 

20 difference between their statistical means and also the 
amount of variance. One can accept or reject the 
hypothesis that the random variables have equal means at 
a given level of "signif icance. " The work of J*. A. Fisher 
was published as: 

25 STATISTICAL METHODS FOR RESEARCH WORKERS 

By Ronald A. Fisher (1925) 
Originally published in London by Oliver and Boyd. 

Therefore, given a level of "significance" one 
can then determine if the average response time for 
30 method A during the sampling interval is significantly 

changed when running coincidentally with method B. 
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Significance levels show one how likely a result is due 
to chance. The most common level, used to mean something 
is good enough to be believed, is .95* This means that 
the finding has a 95% chance of being true. 
5 Methods in a calling sequence are thrown out in 

COM+ by utilizing the causality ID - which is a unique ID 
that is passed from the client through each method in the 
calling sequence. If A calls B (or is in a calling 
sequence chain with A) , B affects the performance of A, 
10 but delaying B will clearly NOT improve the performance 
of A. 

Since overlapping is not symmetric, the F- value 
is also calculated for method B to see if it is being 
affected by method A. The sample size - total number of 

15 calls to A, number of calls to A only and number of calls 
to A while overlapped with B - and the F-value for each 
method pair is stored in the raw analysis report (Block 
2006) . The sample size - the number of measurements 
taken- and the average response times calculated for 

2 0 overlapped only, non- overlapped only and all calls are 
stored in the System Warehouse and can be used for other 
types of analysis or optimization. At step 2007, a 
decision block queries if any more pairs will require 
analysis. The process then ends at step 2008. 

25 FIG. 2B also illustrates the analysis function 

for the Component Balancer - the creation of the analysis 
report. On demand from the user or the automation code, 
the raw analysis report is digested in two steps before 
being given back. The process begins at step 2009, and 

30 follows by a report being requested by the user at step 
2 010. The next step 2011 generates an intermediate 
report for each method pair and accumulates the n umb er of 
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statistically significant F-values accumulated over the 
life of the analysis (Block 2011) . An P-value is 
considered statistically significant if it is above 60% 
probability for the sample size. Sample sizes for non- 
5 overlapped and overlapped operations must each be greater 
than 10. A statistically significant variance indicates 
a possible interference between a pair of methods and 
that there is a possibility that the performance of one 
method can be improved tinder a load by delaying the other 
10 method. 

The next step 2012 involves processing the 
method pairs to calculate the significant F-values and 
add them to the intermediate report. Then query block 
2 013 asks whether the resulting value is positive or 

15 negative. Significant differences for methods affected 
by other methods when considered positive are then 
assigned a score of +1 (Block 2013P) , which indicates the 
method is a candidate for optimization. Significant 
differences for methods affecting other methods are 

20 considered negative and assigned a score of -1 (Block 
2013N) , indicating the method as a candidate for delay. 
A number of independent time samples are used in the 
analysis process. During the step 2012, the scores from 
each of these time samples are accumulated. If the 

25 resulting value is positive, the method is considered a 
candidate for optimization. If the resulting value is 
negative then the method is considered a candidate for 
delay. At step 2014 , there is a viewing of the final 
report . 

30 A simple COM+ application was developed to test 

and verify analysis results. The application has one 
component with four methods: getSpecialOf f ers, deposit, 
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withdraw and checkBalance. The application internals 
were as follows: deposit directly affects checkBalance; 
withdraw calls checkBalance and getSpecialOf f ers runs 
without interfering with or being interfered with other 
5 methods . 

A test harness was also developed to drive the 
application with a random workload. A 25 -minute run was 
made on a single processor laptop, with eight users per 
method being called at a random rate between 0 and 900 

10 milliseconds. The results are given in Figure 7 below. 

The top three lines in the report show the 
final digested results, the bottom four lines the 
intermediate results. As expected, deposit (-16 = -12 -6 
+ 1 +1) is shown as the only potential delay, with 

15 checkBalance (11 = 12 -1) a good potential for 
optimization, followed by withdraw (5 = 6 -1) . One would 
expect numbers like this as withdraw is indirectly 
affected by deposit. 

FIG. 3 is a flowchart, which illustrates the 

20 optimization function of the Component Balancer. Queue 
entries are processed in real time as they come in from 
the target partitions of Fig. 1 (Block 3001) • As new 
groups or methods are encountered in the queue entries, 
they are added to the working set in memory in the 

25 Component Balancer server (Block 3002) . The working set 
contains the information necessary to do the optimization 
- such as running average response times and calls per 
second, etc. 

Optimization calculations are done every few 
30 seconds on each group in the working set (Block 3003) . A 
delay increment is calculated using fuzzy logic for each 
method targeted for optimization in the group (Block 
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3004) . The delay increment can be positive or negative. 
The largest delay increment for methods in the group is 
chosen and added to the current delay - but not allowed 
to exceed a maximum of 300 milliseconds or to go below 
5 zero (Block 3 005) . The delay conditioner from the CB 
Server 1005 (FIG. 1) is given a maximum delay factor 
between 1 and 3 that it uses to calculate the delay it 
actually uses on the method - so the maximum any method 
can be delayed is 900 milliseconds. The Component 

10 Balancer 1004 automation uses a maximum delay of 3. 

The calculated delay is pushed out to the 
machines where the delayed methods are located by writing 
a registry key entry on those machines (Block 3006) . An 
inquiry is then made to check if no conditioned methods 

15 were called for a one-hour period (Diamond 3010) . If one 
hour elapses with no queue entries for a method (Yes to 
inquiry 3010) , that method and all of its information is 
removed from the working set (Block 3 011) . If the answer 
to inquiry 3010 is No, and no activity has occurred in 

20 the working group for 10 seconds, which is checked by 
inquiry 3007- that is, no conditioned methods were called 
- the delay is set to zero (Block 3012) . The process 
then ends at bubble 3013. 

The Monitoring of Response Time Goals is shown 

25 in FIG. 6. The Component Balancer user interface allows 
the user to monitor the response times of groups of 
methods selected for optimization* An overall goal c an 
be established for each group. The range of the goal is 
from no goal - where no delays are enabled - to the 

30 maximum goal - where the most aggressive delays are 
allowed. 

awk \ app 1 \ AWK0 2 - 0 0 4 . doc 



27 



The user can adjust the goal and view the 
effect before picking a setting, or abandoning the 
optimization if the effect is unacceptable* 

The individual methods chosen for optimization 
5 in a group are graphically monitored against the goal. 
Running average response times in milliseconds are 
plotted against the response time goal in FIG. 6. 
Running average transaction calls per second are also 
graphed to show method load trending. 

10 Test Results: 

A simple Weblogic application was developed 
that was a stripped down version of an IBM banking 
benchmark used for testing J2EE application server 
performance. This version has a single session bean with 

15 three methods: balancelnquiry, deposit and withdraw in 
FIG. 8. Each method accesses a SQL database. A test 
harness that drove the application and monitored the 
responses was also created. The test harness accesses 
the bean directly and does not go through a web page, so 

20 actual bean response times are being monitored and 
optimized. In the test results below, the test harness 
ran on the system being optimized, so no network traffic 
was involved. 

The goal was to optimize the response time of 

25 the deposit method at the expense of the other two 
methods (FIG. 7) . The test was run with a workload 
equally distributed among the three methods with 50 users 
spread across 8 WLS servers on an ES (Enterprise Server) 
system with 16 processors. The results are given in 

3 0 Figure 8. 
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The end columns (FIG. 8, top and bottom) under 
the Response Time in Milliseconds show response times for 
the three methods without and with Component Balancer 
optimization. The faster response times a, b, c show 
5 results of optimization, and the two columns Kl, and K2 
in the middle show the results of other optimizations 
that were applied prior to Component Balancer 
optimization. These optimizations were affinitizing 

processors and adjusting heap sizes. 

10 FIG. 4 is a diagram illustrating the fuzzy 

logic used in the Component Balancer of FIG. 1. The 
fuzzy logic takes three parameters (Block 4001) - the 
current average response time, the current average calls 
per second (cps) and the previous average calls per 

15 second for trending - that is, to determine whether the 
load is increasing or decreasing over time. The two 
average calls per second values are used to determine 
load trending. The process begins at step 4000, and all 
parameters are normalized to values between 0 and 100 

20 against the current response time and cps ranges before 
they are passed to the fuzzy logic (Block 4002) . 

The parameters are "fuzzified" - the response 
time is converted to "fast", "ok" and "slow" at step 
4003, and the calls per second are converted to "low", 

25 "medium" and "high" at step 4004. The fuzzy logic 
executes a set of rules given these parameters (Block 
4005) . For example, if the response time is ok and the 
current cps are high and the previous cps are low, then 
the fuzzy logic outputs a positive delay increment. This 

30 means that, since the load has increased, a response time 
increase is anticipated and a bigger delay most likely is 

needed for the methods selected for delay in order to 
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maintain the response times of the methods being 
optimized. The delay value is then "defuzzif ied", that 
is, converted back to a number in the accepted range and 
returned (Block 4006) and the process ends at bubble 
5 4007. 

The delay increment moves smoothly over its 
allowed range based on how "ok" the response time is, how 
% *high" the current cps are and how "low" the previous cps 
were as the fuzzy inputs can take on a range of values. 

10 The target response time is the current maximum response 
time (100%) if the maximum goal is chosen. No 
optimization is done if no goal (0%) is chosen. For any 
goal in-between, the target response time is in the same 
relative range between the current lower and upper 

15 response times as the goal is between 0 and 100%. For 
example, if the goal is 50 and the response time range is 
between 50 to 150 milliseconds, then the response time 
goal will be 100 milliseconds. 

The upper response time value and lower cps 

2 0 value are reset every minute. Doing this forces the 
optimization to squeeze towards an optimum target 
response time. The lower response time value indicates 
the current best value that the method can run at. The 
upper cps value indicates the current best throughput for 

25 the method. 

Described herein has been a method to provide 
analysis and optimization of Component -Based 
applications. A Component Balancer establishes and 
maintains response- time goals for selected business 

30 logic, which is contained in component -based 
applications. This can be accomplished by selectively 
delaying the business logic used in other component 
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methods, possibly in other applications or on other 
machines. This can be done without re-compiling or re- 
deploying the applications involved. Thus, even as the 
load on the system varies, the Component Balancer works 
to maintain the response time goals, which were set. 
This is done at the expense of lower priority methods. 
This allows smoother resource utilization under varying 
and peak loads. 

While one embodiment of the invention has been 
illustrated, other embodiments are possible which are 
still defined by the attached claims. 
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